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Abstract 



Systems out of equilibrium, in stationary as well as in nonstationary regimes, display a linear re- 
sponse to energy impulses simply expressed as the sum of two specific temporal correlation functions. 
There is a natural interpretation of these quantities. The first term corresponds to the correlation 
between observable and excess entropy flux yielding a relation with energy dissipation like in equi- 
librium. The second term comes with a new meaning: it is the correlation between the observable 
and the excess in dynamical activity or reactivity, playing an important role in dynamical fluctua- 
tion theory out-of-equilibrium. It appears as a generalized escape rate in the occupation statistics. 
The resulting response formula holds for all observables and allows direct numerical or experimental 
evaluation, for example in the discussion of effective temperatures, as it only involves the statistical 
averaging of explicit quantities, e.g. without needing an expression for the nonequilibrium distribu- 
tion. The physical interpretation and the mathematical derivation are independent of many details 
of the dynamics, but in this first part they are restricted to Markov jump processes and overdamped 
diffusions. 

keywords: nonequilibrium, fluctuation-dissipation, linear response. 
PACS: 05.70.Ln, 05.20.-y 

1 Introduction and main result 

To know a system is to know its reaction to external stimuli. Linear response theory applies when the 
effects are comparable to the causes and so far has been systematized only for systems in complete 
thermodynamic equilibrium [4i\ [5j [26] . The result is summarized in the fluctuation-dissipation theorem 
|32tll(J| stating that the response of an equilibrium system to small external perturbations is proportional 
to its fluctuations: an impulse changing the potential U — > U — h s V at time s, will produce a response 
R*Qy(t, s) = 5{Q(t)) /5h s \h=o m a quantity Q at time t > s given by 



Here (V(s) Q(t)) eq is the equilibrium time correlation function between V(s) and Q(t) and f3 = 1/ksT is 
the inverse temperature. For example, for an Ising spin system aj = ±1 in equilibrium with energy func- 



magnetic field, one finds the (time-dependent) susceptibility in terms of the spin-spin correlations in 
the equilibrium process: 




(1) 





When h s = h is constant over s £ [0, r], then to first order in /i and for t > r, we get the thermoremanent 
magnetization by integrating the previous formula: 

£ [<a<(i)>* - taflWaJ = ^ E <M r ) " °-*(°)] ^W)^ ( 2 ) 
i *,j 

The equilibrium process (-) e q is time-reversible and can for example be specified here by a Glauber spin 
flip dynamics leaving the equilibrium distribution ~ exp[— [3U(a)] invariant. The usual proof of ([I])-© 
proceeds by applying first-order time-dependent perturbation theory and by inserting the equilibrium 
condition. We review it in Appendix ICl and we indicate the problem with this approach for extending 
it to nonequilibrium conditions. 

In the present paper we generalize the equilibrium response formula (pQ) to nonequilibrium regimes 
(stationary as well as nonstationary ones). In this first part we treat Markov jump processes and 
overdamped diffusions as simple nonequilibrium models ignoring inertial degrees of freedom. In this 
context, formula dU) changes to ([5]) below. A second part [4] following this paper will give extensions, 
in particular to underdamped diffusion processes, which are noisy Hamiltonian systems, and to general 
space-time local processes that are defined from their distribution on path-space. 

To get a first understanding of the meaning of our generalization it is instructive to view already 
([1]) not just as the outcome of a perturbative calculation on the level of evolution operators, but rather 
in its relation with dissipative effects, cf. [22]. The point is that (pQ) is a correlation with the entropy 
flux associated to the perturbation. To see it, we apply (pQ) to write the difference (Q(t)) h — (Q(t)) eq 
between the perturbed average and the original value as the time-integral 

0^dsh s -^(V(s)Q(t)) eq 

= p(^h t V(t)-h o V(0)- J*ds^h s V(8)} Q(t)^ (3) 

and we recognize the correlation of Q(t) with the entropy flux 

^ L t V(t) - h V(0) - J*ds ±h s V(s)\ (4) 

Indeed htV(t) — hoV(0) is the extra change of energy in the environment due to the perturbation, and 
Jq ds h s V(s) is the work done on the system by the perturbation. To be precise, the entropy flux here 
is an excess flux of the perturbed process with respect to the unperturbed one (oc U(t) — U(0)). This 
has an immediate analogue under nonequilibrium conditions when we think of the entropy flux ([4]) as 
the excess with respect to whatever steady or transient entropy production the system might already 
possess. 

However, from dynamical fluctuation theory we have learnt that there is more than just dissipation 
or entropy production that governs the fluctuations around nonequilibrium J37J EH EE] . A novel quantity 
has appeared, which we call dynamical activity or traffic, a measure for the system's nervosity or internal 
reactivity. This dynamical activity is time-symmetric, in contrast with the entropy production which 
leads time's arrow. It was first introduced in |41l 134] and studied in the context of nonequilibrium phase 
transitions [23], of critical behavior [25], for characterizing the ratchet effect [18) . and for large deviation 
theory, e.g. in [21E1E7J. Close to equilibrium, entropy production and dynamical activity merge, as 
can be understood from observing that when approaching equilibrium the currents loose their direction 
to become merely elements of (time-symmetric) traffic between the states of the system. Further away 
from equilibrium, dynamical activity and entropy production are really different and play side by side 
in characterizing the nonequilibrium. Then, formula ([1]) splits in two separate terms, one entropic, the 
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other frenetic, to be explained below. That is made visible in a generalized response formula, written 
here for the nonequilibrium situations to be specified below: (|TJ) must be changed into 

fl&yfc s) = £± (V(s)Q(t)) )l - | (LV(s) Q(t))„ (5) 

In ([5]) we have an arbitrary initial distribution \x for a given nonequilibrium process (over which we 
average on the right-hand side). The first term is exactly like in equilibrium (but with 1/2); the second 
term is the correlation with the linearized dynamical activity (the correlation between Q(t) and the 
function (3 LV at time s) which is new with respect to the equilibrium (UJ). For its interpretation we 
restrict us here first to jump processes. For the dynamical activity we must then look at the escape 
rates, i.e. at the frequencies by which the Markov jump process leaves a state x. Suppose the process 
has rates W(x, y) for the transitions x — > y. The escape rate at state x gets changed by the perturbation 
h s V. Its excess is 

v y 

= ^(LV)(x) (6) 

to linear order in h, and L is the backward generator of the jump process: 

(V(s)) x 

In (JSJ) we have abbreviated LV(s) = LV(x s ) for x s the state at time s. More details will come in 
the next section, where the precise set-up and meaning will be given. Section [J] gives examples and 
makes visible the relative contribution of the two terms in ([5]). Most importantly the new formula 
is presented in Section [5] and [6] with its statistical mechanical interpretation. Section [7J makes the 
relation with the ambition of effective temperature. Section [5] still connects our work with previous 
formulations, especially those in [T5l [36l [35l [T9J, [50J, [131 SZ] - The Appendices give (A) explicit calculations 
for illustrating the formula? of Section (B) the response-formula for discrete time Markov chains, 
useful for simulation purposes, and (C) the comparison with formal perturbation theory and with the 
co- moving frame interpretation of |13j . 



LV(x) = A 



2 What nonequilibrium? 

We consider open system first-order dynamics realized in Markov jump and diffusion processes. These 
define probabilities on the trajectories uj = {uj t ,t > 0) of the system by specifying the updating mecha- 
nism ut — > 0Jt+dt- The state at each time is denoted by ut = x and corresponds to a reduced description 
of the universe, such as positions or elements of a discrete set of configurations. Steady equilibrium reser- 
voirs are integrated out and replaced by effective external forces and noise. The nonequilibrium condition 
can be imposed by external driving fields or by installing mechanical displacements or chemical gradi- 
ents at the boundaries of the system but all external driving is here assumed to be time- independent. 
Examples will come in Section UJ further details will not matter. 

The updating is given in terms of a generator L in the sense that for all single-time observables f(x) 
(functions of the configuration x of the system) and for all initial distributions [i: 

= <(£/)(«*)>„ (7) 
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which is equivalent to saying that 

</(<*)>„ = J dxp(x)(e tL f)(x) = (e tL f), 

In words, e tL "pulls a function f(x) back to the time of the initial density p,(x). n L is therefore often 

called the backward generator. More in general, for any two observables / and g, their correlations at 
times < t < s satisfy 

^(f(u 8 )g(ut)) = ((Lf)(u a )g(uH)), 0<t<s (8) 

for an arbitrary average at time zero and over all allowed trajectories. 

We now specify the two classes of processes we deal with in this first part. 

2.1 Jump processes 

. on which transition rates W{x,y) give the probability 
-> y. No detailed balance is assumed. We write p for a 
p(y) W(y,x)] = 0, x £ K. In this case the generator L 
- W(x, y) and with diagonal elements equal to minus the 

Lf(x) = J2W(x,y) [f(y)-f(x)] 
y 

and by stationarity ^2 X p(x) Lf(x) = 0. 

We think of the states x as configurations of a mesoscopic system undergoing a Markov evolution, 
such as for chemical kinetics or for models of interacting components on a lattice which are driven away 
from equilibrium, cf. example 14. H the state x is then the total configuration and the transitions are 
local; response in discrete time is treated in Appendix iBl 

At time t = we draw the initial state from an arbitrary probability distribution p(x),x £ K. For 
t > we apply the perturbed dynamics with transition rates 

W t {x,y) = W(x,y)e ! ^ 1[v(y ' ) - V(x)] (9) 

for some potential V with small amplitudes h. We thus switch on another channel of energy exchange 
with a reservoir at temperature T. This is a standard type of perturbation in Markov jump processes 
by which we add a potential; we will stick to that. More general types of perturbation are possible, as 
for example in [Jj5] but for these the specific formula (0) has to be modified, see |4(Jj . 

2.2 Overdamped diffusions 

Overdamped diffusions are stochastic processes defined in the Ito-sense by 

dx t = {u(x t )[F(x t ) -VU(x t )] + V-D(x t )}dt + y/2D(x t )dB t (10) 

Now i£l <! and the noise is present in the form of the d— dimensional vector dBt having independent 
standard Gaussian white noise components. We assume that the environment is in thermal equilibrium 
at inverse temperature (3 > imposing the condition v(x) = [3D{x) between the bare mobility v and 
the diffusion matrix D; they are strictly positive (symmetric) d x d— matrices. The relation v = (3D is 
easily confused with the fluctuation-dissipation theorem; they are only equivalent in equilibrium. More 
in general, v = (3 D is an expression of local detailed balance assuring the proper physical identification 



We consider a finite space K of states x, y, . . 
per unit time to jump between the states x - 
stationary distribution, X^ye-ftr[/°( x ) ^( x >2/) — 
is the matrix with off-diagonal elements L xy = 
escape rates, L xx = — ^ v W(x,y). Hence 
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of the various terms in the equation (jlOp . There is a potential U and the force F represents the nonequi- 
librium driving. We do not specify here regularity properties or boundary conditions. Equilibrium (TTJ) is 
obtained when F = 0, for stationary p oc exp(— fiU). The diffusions (|10p are called overdamped because 
they have forces proportional to velocities. These processes are high damping limits (sometimes called 
Smoluchowski limits) of underdamped or inertial stochastic dynamics that will be considered in Part II 
@]. On the other hand, formal extensions to stochastic and driven Ginzburg-Landau models (models 
A-B-C in [9]) do not seem difficult. Examples come in Sections 14.21 - l4~3l 
The generator of the dynamics (jlOp reads 

L = v(F- W) • V + VD- V (11) 

The time-dependent perturbation changes U in (|1U|) into U — htV for t > 0. In other words the 
Hamiltonian part of the dynamics of the system gets an additional conservative force with a time- 
dependent amplitude. Here also we assume that v and D are unchanged under adding the potential 
h t V. 



2.3 Main question 

What to expect at time t > for an observable Q ? There will be a shift in its value, deviating both 
from the original expectation and from the stationary value: 

? (Q(t)) p = (Q(0)) p (12) 

Note that we abbreviate Q(t) = Q(xt). The right-hand sides average over the unperturbed dynamics, 
the upper one starting from p and, on the next line, when starting from the stationary p. Linear 
response theory for systems out of equilibrium aims at estimating and interpreting the deviations 

(Q(t))i - (Q(t))n 

to first order in h. In this linear regime, one studies the deviations of an observable (Q(t)) h from its 
expected value {Q(t)) in the unperturbed dynamics, 

(Q(t)) h = (Q(t)> + f ds h s R QV (t, s) (13) 
Jo 

where 

p x _ S(Q(t)) h 

is the response of a quantity Q(t) to a (small) impulse h s at a previous time s < t. 

The initial distribution p will be remembered via super- and subscripts, where appropriate. A 
special and interesting case is the stationary response for p = p. 



3 Nonequilibrium response formula 

Under the previous set-up there is a simple general formula for the linear response derived in [3], the 
same for all observables Q and V: 

*Svfe ») = f ^ (V(s)Q(t)) fl - | (LV(s) Qit))^ (15) 
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The first example of a formula of this kind is Eq.(22) in Ref. [36], dealing with discrete spin systems. 
Since random paths are not smooth, it does not make sense to take the time-derivative inside the 
expectation in the first term. On the other hand, for s > i, (jSJ) can be applied and as a consequence 
causality is automatically verified in (|15j) : the response vanishes for s > t. One can thus also rewrite 
(|15p in a more symmetric way which is however only valid for t > s: 



^(LV(s)Q(t)-LV(t)Q(s)) fi (16) 



Equations of this form can also be found back in the literature citeckp,lipp,diez. Our main goal here 
is to extend these earlier results and others (such as in 113[ into the general and usable formula 
(|15p , and, most importantly, to accompany it with an interpretation derived from dynamical fluctuation 
theory. That will be continued in [3], showing further robustness of the interpretation. 

In the introduction Section Q] we have already briefly introduced the statistical meaning of the two 
terms on the right-hand side of (f5j)= (fT5|) . More is to come in Sections [5] and The first term in (|15p 
(as in dl])) is a correlation with the excess entropy flux. Secondly, there is the correlation between Q(t) 
and j3LV(s), a quantity that we call frenesy, derived from the adjective frenetic or frantic. In contrast 
to the entropy production, which has a preferred direction in time, frenesy is a time-symmetric quantity. 

Let us also see how formula (|15p reconstructs the equilibrium formula ([T]). In this case \i = p is the 
equilibrium distribution with the process satisfying time-reversal symmetry, with s < t 

(LV(s)Q(t)) eq = (LV(t)Q(s)) eq 

= J t (V(t) Q( S )) eq = ~(V(t) Q(s)) cq = ~{VC) Q(*))eq (17) 

which is the first term in (|15p . Since by (|17p in equilibrium the frenesy-correlation exactly equals minus 
the correlation with the entropy flux, the two terms on the right-hand side of (|15p add up to give ([I]). 

We end the section with the formal proof of formula (|15p . which is easy when going to path-space. 
We should write the perturbed expectation value in terms of the unperturbed one. More explicitly we 
consider paths to = (uj s ) over the time-interval s £ [0, t] to write 

f dP h 
(Q(t)) h = J dPM^-MQfa) 

where the dP's stand for path-probability densities in the perturbed (superscript h) and unperturbed 
processes. In particular, for the jump processes of Section [2TTI 



for a path to = (u>q — > uj^ u>t n = oJt)- As a consequence, 



n 



Aph a 

^ k=l 



- T t dsW(u s ,y)[e^ v ^- v ^ -1] (18) 
v Jo 

where the first sum is over all the jump times (ti,... ,t n ) in u, and we put to = and t n+ \ = t. 
Remember that the path is constant between the jump times so that 



ft A 

/ ds-h s V(u s ) = J2 V M[ht k+1 -h tk ] 

J ° k=0 

n 

h t v(u t )-h v(u;o) + ^ft t JyKJ-yK)] 



k=l 
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by partial summation. We can therefore rewrite the first line of (|18p and substitute ([!]). The rest is 
expansion to first order in h for a finite number of terms, almost surely under dP^(cj). In particular, 
the frenetic term appears as the first order in the time-symmetric part (second line of (|18p ). like in ([6]). 

The strategy is unchanged for overdamped diffusions. There, the paths to = (x s ) are continuous and 
the action (|18p can be found in the stochastic integral 



dP a r 

log^H = f W dx s VV(x s )h s 



+ dsu(VU -F)(x s )-h s VV{x s ) + 0(h 2 )^ (19) 

The first Ito-integral can be rewritten in the Stratonovich sense (with the "o" -notation in the integral) 

/ dx s W(x s ) h s = dx s o VV(x s ) h s 
Jo Jo 



+ f dsh s VD ■ VV(x s ) (20) 
Jo 
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where the last term can be combined with the second line in (|19p to make /3LV/2, see (jlip . Moreover, 

/ dx s oVV{x s )h s Q(x t )\ = [ dsh s -^-(V(s)Q(t)) tl 
Jo I \ Jo ds 

The rest is again trivial expansion. 

4 Examples 

It is often more convenient to visualize the integrated version of (|15p for a small but constant pertur- 
bation h s = h, s > 0. Then, the generalized susceptibility 

x(t) = l[(Q(t)) h -(Q(t)) 

is given by 

x(t)/P = \[C(t) + K(t)] = C NE (t) (21) 



with correlation function (coming from the entropic term in (|15p ) 

C(t) = (V(t)Q(t)) - (F(O)Q(t)) 
and a term (coming from the frenetic term in (|15p . extra with respect to equilibrium) 



K(t) = - [ ds{LV{s)Q{t)) 
Jo 



representing an integrated correlation function. The average of C and K, denoted by Cne^) in (|2ip . 
thus has to be equal to xif)l ' P in general. If extended to 1 1 oo, gives the change in nonequilibrium 
stationary expectation when adding a small potential. 
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4.1 Driven Kawasaki dynamics 

Consider an exclusion process as a model of ionic transport through a narrow channel. This is described 
by a collection of n sites, labelled by i = 1, . . . , n, each holding either one particle {x 1 = 1) or none 
{x 1 = 0). In the bulk of this system no particles are created or annihilated, only jumping to neighboring 
sites is allowed via a Kawasaki dynamics. At the edges i = l,n particles can move in or out from 
reservoirs with density d\ and d n , respectively. The form of the response formula (fT5|) is unchanged by 
adding a nearest neighbor interaction with energy U(x) = — X^ILi ■ Moreover, we can add an 

"electric" field E promoting particle jumps to the right. Since it is a Markov jump process, there are 
transition rates for particles hopping to neighboring sites and rates for creation and annihilation at the 
edges. For example, a particle enters into site i = 1 from the reservoir with rate 

W(x,y) = dxij){x,y) exp - U(x)}\ , i>(x,y) = ip(y,x) 

where y = x except that x 1 = while y = 1. The rate of the reverse transition can be found by 
imposing local detailed balance. Similarly, in the bulk, when e.g. x % = l,x l+1 = and y is reached by 
inverting these occupations, 

W(x,y) = ip(x,y) exp j-^[*7(y) - U(x) - E}\ , i[>(x,y) = ip(y,x) 

Simple nonequilibrium conditions can thus be introduced either by 

i) setting different reservoir densities d\ ^ d n , or 

ii) setting a nonzero electric field E > in the bulk. 

We choose the total number of particles M(t) = Y17=l x% as observable. We also introduce a pertur- 
bation V{s) equal to AA(s), which means that we are changing the chemical potential of both reservoirs 
with a common shift. Transition rates for the perturbed process are thus multiplied by a factor e^ hs / 2 
if a particle enters the system, and by e~^ hs ^ 2 when a particle leaves; transitions in the bulk are left 
unchanged. 

In this case the frenetic term is with LV = J(s), the systematic current, and represents the expected 
change of the potential M per unit time, i.e., it is the rate of change in the number of particles from the 
two possible transitions at boundary sites. Thus, for x — > y the transition modifying x , and for x — > z 
the transition modifying x n , we have 

J(x) = [N{y) - M(x)]W(x, y) + \M{z) - M(x)]W(x, z) 

We have numerically verified that \ = C = K under equilibrium conditions. While C = K to excellent 
precision, the shape of x depends weakly on h, and is found to converge to C only for h sufficiently 
small. In fact, one can pretend exact matching only in the limit h — > 0, but h = 0.01 turns out to be 
sufficiently small to achieve a good convergence. 

A representative example for the nonequilibrium case i) is shown in Fig. [T^a) . One can see that each 
of the functions C(t) and K(t) is a poor approximation of the response, while the agreement between 
CNE{t) and x(t)/fi is excellent. 

In Fig. QJb) we show an example of nonequilibrium condition ii). Again, only C NE(t) matches 
x{t)/(5. Curiously, a comparison of this example with the previous one reveals that C can be either 
larger or smaller than K, even for two nonequilibrium conditions that look pretty similar, in the sense 
that they yield a current in the same direction for a relatively simple system. 
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Figure 1: Plot of the quantities involved in Eq. (|21 j) . for (a) case i) (E = 0) with L = 10, (3 = 1, 
h = —0.01, and reservoir density unbalance d\ = 0.9, d n = 0.1, and (b) for case ii) {d\ = d n = 0.5) with 
L = 10, f3 = 1, h = -0.01, E = 3. 



4.2 Diffusion on the circle 

Consider the Langevin equation for a particle position xt £ S 1 on a circle driven by a constant field 
F(x) = f and subject to a time-dependent forcing: 

dx t = u[f - U'{x t ) - h t V'{x t )]dt + V2D dB t (22) 

Here the prime denotes differentiation with respect to space. The term ht V is the time-dependent 
perturbation while dBt is a standard Gaussian white noise. The diffusion constant D and the mobility 
v are related by the Einstein relation v = (3D, with j3 the inverse temperature. 

This example has been recently experimentally realized as reported in [23], for testing the co- 
moving frame interpretation of [J3] also explained in AppendixO In fact, its nonequilibrium stationary 
distribution p is known analytically, see |38j. 

Here we show the result of a simple simulation of the overdamped particle studied in the experiment, 
with potentials and observable U(x) = Q(x) = V{x) = sin(x), and a constant force /. The frenesy 
j3LV{x) of a particle at position x can be computed by applying the generator of the overdamped 
dynamics 

to the potential V(x), which gives f3LV(x) = (3[f — cos(x)] cos(x) — sin(x). We have measured the 
correlations C(t) and K{t) as well as responses x(i) for small h, see (|2ip . 

Fig. [21(a) shows that for strong stationary nonequilibrium / 3> there is a large difference between 
the integrated correlation function of the frenesy and that of the entropy production. However, their 
average CNE(t) agrees very well with the response x(i), as it should. 

It is important however to recall that our approach works for nonstationary regimes as well. In 
Fig. [2Kb) we show an example of a particle starting at time t = from a nonstationary initial distribution 
fj,(x) = 5 x fi (i.e. its position is xq = 0), but for the rest not forced outside equilibrium, / = 0, 
to emphasize the transient character of this situation. Again, we can see that the response is well 
estimated by Cne{£)- 

In the second part [1] we will treat the inertial version of this model. 
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Figure 2: Response and fluctuations of the overdamped particle in a tilted periodic potential, as dis- 
cussed in the text, with inverse temperature (3 = 0.2, mobility u = 1 and perturbation h = —0.02. 
(a) Steady state regime, with initial distribution equal to the stationary one, and force / = 0.9. (b) 
Transient regime, with initial position xq = and force / = 0. 

4.3 Driven Brownian motion 

Consider again the overdamped Langevin equation ()10p but with constant v = (3D: 

(dzj) = v ij [f j (x t ) + h j ]dt + V2D 3 dB} 

with repeated indices j = 1, . . . d summed over. The / includes all forces and h is the small constant 
perturbation. The true mobility M is defined as the response 

dhl 

while the real diffusion matrix is given by 

rt rt 



M ij = lim ^r-(x\) 

t^oo dhl \ t h 



(23) 

h=0 



/0 ^0 1 ' ' r 'Pip 

As (|23p is a response function, we can easily compute it within our framework. After a straightforward 
calculation, it follows that 

M* = 0VV - ^1 Um I f ds f dr (f k {x s ){x\ - (j?) )) (24) 

Note also that (A*) = (v 13 f 3 (x)) ■ Observe that in equilibrium, the second term in (|24[) vanishes be- 
cause the observable x% is anti-symmetric, and {x) eq = 0. Then, the equilibrium fluctuation-dissipation 
relation holds with M = /3T>. Its violation for nonequilibrium, i.e., that there is a correction (= sec- 
ond term) in (|24p . is completely compatible with the condition v = (3D for the reservoir in thermal 
equilibrium at inverse temperature (3. 

5 Dissipation: the entropic term 

Even at equilibrium, the response to an external perturbation is a nonequilibrium process involving 
a transient with production of entropy. In steady nonequilibrium conditions instead we deal with the 
excess in this entropy production, as the starting point is already a regime with nonvanishing flows. 
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In equilibrium it is known that the response function is closely related to the energy dissipation of 
the system into the environment. In systems driven out of equilibrium things get more complicated: 
even when the system is not perturbed there is already a (time extensive) heat dissipation. This is 
the housekeeping heat that is needed to maintain the (unperturbed) nonequilibrium stationary state. 
Perturbing the system then gives additional heat. We see here that the prediction in [36] that the usual 
equilibrium relation between response and dissipation is preserved when taking into account only the 
excess heating and ignoring the housekeeping heat, is indeed true in the following sense. 

During a specific trajectory of the system, the heat dissipation can be split into two parts: Qhk + 
Qex [33 [30] . The first term is the housekeeping heat while Q ex is the extra heat generated through 
the perturbation, and is just the temperature times the excess entropy production, which we already 
encountered in our calculations (J3J) — - 

Let us assume that the amplitude h s is periodic with period t so that it makes sense to consider the 
expectation of the excess heat over the interval [0,t]: 

(Q ex ) h p = £dsh s ±(V(s)) h p 
We expand the expectation value of V using the definition of the response function Rvv'- 

(V(s)) p + [ drR vv (s,r)h r 
Jo 

Here (V(s)) is independent of s because of stationarity and Rvv(s, r) = lZ(s — r) = for s < r so that 

rt J r+oo 

(Qex}p = - ds—h s / a\r1l(r)h s _ r 

J J — oo 

where the right-hand side is exactly the same expression as in equilibrium for the dissipated energy 
over one period. As is standard, see e.g. [26} I44j. the last relation can be rewritten in the frequency 
domain to obtain now the (excess) heat proportional to the imaginary part of the Fourier transform of 
Rvv = We conclude that also out-of-equilibrium the imaginary part of the Fourier transform of the 
generalized susceptibility is related to energy dissipation, but only of the excess heat. Observe finally 
that the imaginary part of the Fourier transform is the Fourier transform of the time-antisymmetric 
part of Rvv an d that we have already written down this time-antisymmetric part: it is the right-hand 
side of extended to t < s. 

6 Activity: the frenetic term 

As we have seen, besides the entropy flux there is yet another relevant quantity getting into the picture. 
It is a younger concept in nonequilibrium studies as witnessed by the fact that its name has not been 
settled yet: it has been called traffic [3T], [38l [39] or dynamical activity [HJ EJ [25l [23] , to denote a property 
related with the volume of transitions or changes performed in time. We like to refer to it as frenesy, a 
name that sounds more similar to entropy or energy. This quantity is time-symmetric, in the sense that 
trajectories display the same activity if they are spanned in the normal temporal direction or backward in 
time. The relevance of time-symmetric quantities has been anticipated in [41[I34]. Activity denotes thus 
an aspect of the dynamics that complements entropy production (which is time anti-symmetric - flows 
reverse together with time) in the description of fluctuating quantities in regimes out of equilibrium. 

We recall here how the frenesy /dynamical activity appears in dynamical fluctuation theory, choosing 
the set-up of Section I2TT1 (finite state space Markov jump processes xt). 
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Consider the stationary process P p and measure the fraction of time that the system spends in each 
state x £ K: 

i r 

p T (x) = — Lj dt, with 5 a & = if a ^ b and 5 a f, = 1 if a = b 
T Jo 

That is the empirical distribution of occupation times over [0, r] while drawn at time zero from the 
stationary p. When the stationary process P p is an ergodic Markov process, p T is invariant under time- 
reversal and p T — > p for r f +oo. Following the pioneering work in [20] we look here at the fluctuations 
around that law of large times, for which it is known that 

Prob p [p T ~ p] ~ e" r/M , r T +oo 

See e.g. [T7j for a precise description of this fluctuation formula. The exponent is governed by the 
functional I(p) > 0, with equality for J(p) = 0. There is a variational expression for the fluctuation 
functional I(p), 



I(p) = sup I - A*0» 



£ W(x, y )e^y)-V(x)] _ W(x, y) 
i y y 



(25) 



in terms of the excess escape rates when adding a potential — V much as in ([9]). The actual supre- 
mum is then reached for the potential V that makes p stationary; i.e., by changing W(x,y) — * 
W(x,y) exp{/3[F(y) — V(x)]/2}. Thus, for that //-dependent potential V, 

I(p) = Y,p(x)W{x,y)-Y,^)W{x,y)e p[v{ - y) - v{ - x)]l2 
%,y y 

- -^^2Kx)LV(x) 

X 

In the second line (expected frenesy in p) we have assumed that p is close to the stationary measure 
(small fluctuations), and we have written the first term in an expansion around p — p, where V is 
supposed to be small as well, again like in ([6]). In other words, the rate I{p) of escape from density p 
is given in terms of the expected frenesy under p. 

For further information on the role of activity /frenesy in dynamical fluctuation theory, we refer to 

[371 EH EH]. 



7 To effective temperature 

While the equilibrium fluctuation-dissipation relation ([1]) is typically violated for nonequilibrium regimes, 
one may wonder whether it can sometimes be restored by the introduction of an effective temperature 
T eS , in the sense 

^v(M) = ^^<n*)Q(% (26) 

Many studies have been devoted to the study of the prefactor, in what sense it perhaps resembles a 
thermodynamic temperature-like quantity for some classes of observables and over some scales of times 
(s/t,s); we refer to [331 \TQ [91 [31] for an entry into the extensive literature. Clearly, whatever the 
purpose of the discussion, an exact expression of the response should help, especially when entirely in 
terms of explicit correlation functions. The first calculations in this sense are in [llj and they have 
been referred to as the "no field-method" [3B]. In particular, for purposes of simulation or numerical 
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verification of (|26p we do no longer need to perform the perturbation by hand. In fact, now we can 
write the ratio T/T cS = X entirely in terms of correlation functions 




(LV(s)Q(t)) IM 
^(V(s)Q(t)}, 



(27) 



with numerator and denominator in (|27j) each having a specific physical meaning as in the previous two 
sections. An effective temperature is obtained as the ratio between the frenetic and the entropic term: 
if for some observables (V, Q) and over time-scales (t/s,t), 



for some Y, then X = (1 — Y)/2. Equilibrium has X = 1 = —Y. In the case where LV ~ as for a 
conserved quantity, then Y = 0. The simplest example is Brownian motion L = A for V the position, 
cf. Virasoro's example in [15J. In that last reference, what are called "flat directions" can be associated 
to perturbations with zero frenesy LV = 0. In the Appendix IA1 we give some explicit results to illustrate 
the above ideas and formulae. 

Finally, X and the effective temperature T eS get negative when the frenetic term overwhelms the 
entropic contribution, which we can expect whenever the perturbation strongly activates the dynamics. 
It is not clear to us whether that relates with the observations in [47J concerning "activated dynamics," 
but certainly, those "active states" with negative effective temperature, here interpreted as highly 
frenetic ones are very different from equilibrium states. 

One should understand that (|26|) represents a rather optimistic scenario. Formula (|26|) wants to 
mimic ([1]) by replacing just one parameter. Why should there be also out-of-equilibrium a single pa- 
rameter and a useful notion of temperature in its usual thermodynamic understanding, and how would it 
depend on the observables V and Q? (See |43| for a very recent discussion.) Answers to these questions 
have been partially given but are often restricted within a context of mean field systems or for small 
fluctuations, effectively dealing with calculations as in Appendix [Aj similar to calculations for scalar 
fields as in [15] and in [9]. In fact, the optimism in (|26p is a sort of conservatism as it wants to attach 
special reference to equilibrium forms and chooses to continue working with equilibrium notions such as 
the temperature. We take a different attitude: the violation of the equilibrium fluctuation-dissipation 
relation (FDR) is an opportunity to discover new connections between response and dynamical fluctu- 
ations away from equilibrium, and to identify these relations in terms of the relevant newly emerging 
physical quantities. 

Let us then try to see how the notion of effective temperature could be seen as a one-parameter 
reduction of a general equilibrium-like FDR that is valid also outside equilibrium but with an effective 
dynamics. The starting point is observing that in the case of equilibrium, formula (pQ) is equivalent with 



That follows from the calculation (|17p . In other words, the fluctuation-dissipation theorem in equilib- 
rium can also be called a fluctuation-frenesy theorem; the two terms on the right-hand side of (|15|) are 
simply the same. Therefore, for purposes of getting closer to equilibrium response formulas one really 
has the choice to mimic either ([1]) or rather (|28p . The first leads to the ambition of effective temperature 
(|26p . the latter to the new notion of effective frenesy. But the latter is also much richer. In fact a simple 
calculation, that we postpone to the end of Appendix[Ul shows that the exact nonequilibrium response 
formula (|15p can indeed be written in the equilibrium form (|28p : 



Y -(V(s)Q(t))^ = (LV(s)Q(t)) fl 



R e J v (t,s) = -/3((LV)(s)Q(t)) 



eq 



(28) 



R» ov (t,s) 



(G^V(s)Q(t)) 



(29) 
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with a new effective frenesy 




L* is the adjoint generator, see (|35p in Appendix The first line in (|30p does not need to assume a 
stationary distribution p, while it is explicitly and implicitly (in L*) present in the second line of (|30p . 
At any rate the operator G^ acting on V in (|30p has the following exact property: it is itself a generator 
(just like the original L in ([7]) or (jSJ)) but of a new dynamics for which p is an equilibrium distribution (i.e. 
(/ (G^g))^ = (g (Gfj,f))fj, for all /, g). Thus, in ([29]) the generator G lla is the instantaneous equilibrium 
generator with respect to the time-evolved distribution p s . This underlies the conclusions of |12j . 

We compare (|29p with (|28p and we recognize the equilibrium form with L for the equilibrium p 
replaced by G^ a for the transient p s . In the stationary nonequilibrium case, we have p s = p and ([30]) is 



replacing L in (|28p . Hence, if the perturbation V is time-direction independent in the precise sense 
that LV = L*V, then the nonequilibrium response ( ([37]) = (fT5j) for p = p) reduces to the equilibrium 
formula ([T]) and X = 1. See |45j for very related conjectures and observations. 

8 Some other previous formulations 

The literature on (extensions of) the fluctuation-dissipation theorem is vast. We apologize for not 
being able to list all possible and even essential contributions. The equilibrium formulation spans all of 
the previous century, while nonequilibrium versions started to appear since the 1970's and very much 
continue up to now. Early works include [H [51] and also |16|, 127], where we see a discussion within the 
theory of stochastic dynamics. In contrast to |27[ [28] our unperturbed process is time-homogeneous. 
Coming to more recent times, violations of equilibrium FDR have been most often discussed in transient 
regimes. For example, in the context of ageing phenomena [31[ 114] . much thought has been given to 
making sense of an effective temperature as briefly discussed in Section [7] 

However, recently much new work has been also directed to find generic extensions of FDR in 
nonequilibrium steady states and to discussions of the dissipative elements in relaxations to nonequi- 
librium. There is for example the line starting from |46t [HOI |4"51 121?] which treats nonequilibrium heat 
effects. In particular [29j might also be useful in real experiments because the FDR violation is there 
directly connected with the energy dissipation. We do not know yet how to relate that to the new 
ideas surrounding the frenetic term in our work or to the physics of "active states" as also in |47] . The 
latter follows the line of [22J, where the connection between the so called fluctuation theorem and the 
fluctuation-dissipation theorem was first explained. 

For other recent extensions of the FDR, we refer to [HI [61 HHJ [501 17J- We also mentioned before 
(at the end of Section [7] and more will come in Appendix [C]) how our approach is related to the co- 
moving frame interpretation of |13[ [24"[ 112] . There, as in the previous references, one disadvantage is 

1 It is called the forward generator because of the definition of the time-evolved measure fit- 



Gp = ^(L + L*) 



(31) 




From this we see that fi t = e tL fi, so that pushes the measure fj, forward in time. 
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that one keeps the stationary density p (or its logarithm) as observable in the fluctuation formula. In 
our approach the largely unknown distribution only enters in the statistical averaging. Being optimistic 
one could say that the generalized FDR of |21|, |4"2] can be used to verify hypothesis on the phase space 
distribution function. Or, one can imagine approximation schemes for making the numerics possible at 
all, cf . [50] . In the same sense the extensions in [61 [13] are also not explicit as they need the information 
on the adjoint hydrodynamics or again on the local probability current, but at least they come with a 
new and still interesting interpretation (reverse response in [6] and co-moving frame in |13} I12j). 

A first generalized fluctuation-dissipation relation giving a response formula in our sense appears 
in Section 2 of [15j . It treats a Langevin dynamics y(t) for soft spin models and the resulting equation 
(2.10) in [15] is exactly our formula (|16p for Q = V equal to y. A very similar treatment is repeated 
in [36] for systems of Ising spins (i.e., within the class of Markov jump processes). Some more general 
treatment again for jump processes is offered in [19], in particular its equations (16)-(17). However 
as before and as mentioned already in the abstract of [TS], " the asymmetry... is not related to any 
physical observable." In contrast, we have emphasized the interpretation via dynamical activity /frenesy 
in nonequilibrium fluctuation theory. In fact, that interpretation is exactly what makes a systematic 
generalization possible at all, as will become even more clear in [5] . The only study in which we recognize 
some of the ideas related to the frenetic term is in [47j . in the context of dynamical systems. 

9 Conclusions 

We have studied linear response relations under general nonequilibrium conditions (stationary and not). 
This first part has dealt with jump processes and with overdamped diffusions, which is the usual set-up 
for discussions on the violation of the fluctuation-dissipation theorem and for the possible emergence of 
an effective temperature. Here we have stressed the emergence of the dynamical activity, or frenesy in 
linear order, as complementary to the entropy flux. Out of equilibrium, dissipation and activity detach 
and the response needs to be evaluated in terms of both entropic and frenetic correlation functions. As 
both correlations are expressed in terms of explicit averages, they constitute a formula ready to use in 
a general context. For example, estimates of these correlations can be obtained with usual averaging 
in simulations, without any need to know further details or approximations of the stationary density of 
states. On the theoretical side, several previous approaches are recovered or have been extended within 
the same scheme. In many cases they have been discussed in specific model dynamics or for specific 
observables. It is interesting that there is a unifying approach with statistical interpretation behind this 
very broad variety of previous results. 

Within the models we considered, more general types of perturbation are possible and interesting. 
For example, what will happen if the perturbation is not of the potential type but actually changes 
the nonequilibrium part or driving of the dynamics? In all these cases our results must be modified, 
of course, but we think that the general method and framework we use is applicable to this wider 
set of questions. Specifically, the concepts of entropy and frenesy will remain the major actors in 
nonequilibrium fluctuation-response theory. 

Acknowledgments: The authors are grateful to Wojciech De Roeck, Andrea Gambassi, Krzysztof 
Gawedzki, Dragi Karevski and Karel Netocny for very useful discussions. BW. receives support from 
FWO, Flanders. M.B. benefits from K.U.Leuven grant OT/07/034A. 
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A Explicit calculations for linear diffusions 

We give here the results of some explicit calculations to illustrate formula (|27|) in Section Similar 
calculations can be found in [151 M ■ 

Fix parameters a,B G R, D > and look at the linear Langevin dynamics for a global order 
parameter MeR, 

M{t) = -a M(t) + h t B + V2D 

for standard white noise The ht,t > 0, is a small time-dependent field. The generator of the 

unperturbed dynamics (on observables /) is Lf(M) = —aMf'(M) + D f"(M). We can think of a 
Gaussian approximation to a relaxational dynamics of the scalar magnetization M (no conservation laws 
and no spatial structure) valid in high enough dimensions (above d = 4 for the standard Ising model). 
Then, in a way, a = corresponds to the critical (massless) dynamics and a > is a paramagnetic 
dynamics (high temperature). By taking D [ we exclude the diffusive aspects and we can think then 
of gradient relaxation in the low temperature regime. 

The equilibrium (reversible stationary density on M for perturbation B = 0) is 

1 ( M 2 } 
p(M) = -exp|-a— | 

with zero mean and variance (M 2 ) = D/a. (Here, a > is needed but not for the finite-time existence 
of the dynamics.) 

We now start from an initial fixed M(t = 0) = Mq. The response function is obtained from 

(M(t)) h Mo = M e~ at + B f ds h s e~ a ^ 

Jo 

or 

±-(M(t)) h Mo (h = 0) = Be- a ^ (32) 

which does in fact not depend on Mq (and thus also equals the equilibrium result). 
The correlation function for < s < t is 

(M(s) M(t)) Mo = Ml e -°(*+ s ) + — \ e - a ^ - e - al - t+s) } 

a 

and hence 

^-(M{s)M(t)) Mo = -«M 2 e- a ( 1+s ' + D[e- a ^ + e ~ a ^] 
When we average that last expression over the equilibrium density (thus replacing Mq by D/a) we find 

^-(M(s) M(t)) p = D e- a{t ~ s) 
as 

which, in comparison with (j32[) specifies the equilibrium temperature to be equal to T = D/ks- 
The frenetic term is obtained from LM = —aM, and thus 

(LM(s) M(t)) Mo = -aMl e" a (*+ s ) - D[ e - a ^ - e^*^] 

Clearly, 

±-{M(t)) h MQ (h = 0) = JL{±(M{s)M{t)) Mo - (LM(s)M(t)) Mo } 

as it should. 
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For the issue of effective temperature we compute the ratio "frenesy versus entropy" as 

Y = Y(M-s t) - -ajM^M^Mo _ -^e^'-Olr'N-e^)] 
1 °' ' ; ±(M(s)M(t)} Mo -ttM V a ('+ s )+D[e-«(M + e-«( ! + s )] 

In that notation, the effective inverse temperature is T = 2T/(1 — Y). In equilibrium Y = — 1 while 
Y = 1 for D = and M + 0. 

For the limit of the "frenetic ratio" 

lim lim Y(M ;s,t) =-1, if a > 

= 0, if a = 

with respectively, T e ^ = T (paramagnetic) and T e ^ = 2T (critical quench), cf. [Sj. 



B Discrete time 

So far we have been dealing with continuous time Markov processes. Nevertheless simulations often use 
an updating in discrete time. It is therefore useful to give the response formula also for discrete time, 
here in analogy with the continuous time jump processes of Section 12.11 Similar efforts have appeared 
before in [Til ES] ■ 

Consider a discrete time Markov process with configurations x,y,... and transition probabilities 
p(x,y). We perturb the system as follows: the new transition probability at time i reads 

v h( x v ) - P( x >y) c ^W(v)-V(x)] 

with normalization 

Zi (x) = Y J P{x,y)e^ v ^- y ^ 
y 

Now consider a path u = (xi), with % = 1, ... ,n, where at time i the system jumps to configuration 
Xi+%. Then the relative probability of the path in the perturbed versus the unperturbed dynamics is 

ph ( g n ~ 1 ™-l "I 

— (w) = exp I -J2hi[V(x i+ x) - V{xi)\ - ^logz(xi) \ 
I i=l i=l J 

The response function becomes 



d 

R Qy {n,m) = ^_(Q( Xn ))J 



h=0 



j {V(x m+ i)Q(x n )) tl - ^ l^2p(x m ,y)V(y)Q(x n )\ , m = l,...,n-l 



\ y 

Again we recognize this as the sum of an entropic term 



and a frenetic term 



2 ([V(x m+1 ) - V{x m )\Q{x n ))^ 



§ (^2p( x m,y)[V(y) - V(x m )]Q(x n ) 
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In equilibrium p, when the process is time-reversal symmetric, that simplifies to (m < n) 

R Q,v( n ' m ) = f {[V{x m +i) ~ V{x m -i)]Q{x n )) eai 

Note that in this discrete version, the entropic and the frenetic terms do not give exactly the same 
contribution to the equilibrium formula, although this discrepancy disappears in the limit to continuous 
time. 



C First order perturbation 

The usual and natural approach to response theory is that of time-dependent perturbation theory, see 
for example [44] . We show here what that gives for the overdamped diffusion processes of Section [2.21 
We prepare the system at time t = according to its stationary distribution p; the perturbation 
—hV is added for positive times. Therefore, for times t > the dynamics has (backward) generator 
(working on observables) 

L h = L + h uVV ■ V, L = v(F — VU + VD) ■ V 
with v = (3D. For the change in expectations at times t with respect to what we had at time zero 

(Q(t)) h - <Q(0)> = / dxp(x) (e tLh - e tL )Q(x) 



we get the linear order 

e tLh - e tL = f e^ L (L h - L) e sL ds + 0(h 2 ) 
Jo 

Or, always to leading order in h I 0, 

l[(Q(t)) h - (Q(0))] =JdsR QV (t,s) 

with response function 



R QV (t,s)= dxp{x)vW{x)-Ve {t ~ s)L Q{x) (33) 



(We are still writing the dependence separately on time s and on time t, for greater generality in case 
the perturbation is time-dependent (through h s ).) The equation ([33]) is not useful as such because 
the derivatives do not commute with the time-evolution. Another way would be trying the partial 
integration 



V- (puVV) =Vp-uVV + pV -vVV = 0p{LV - ^ • W} 

P 



P 

where we have inserted the local stationary current j p (assuming that p nowhere vanishes). As a result 
« e ,(M) = ^/d,* )mi .,^<3W for£ = L-„ W .V (34) 



with local velocity 

function of the stationary density p. 



u(x) = —(x) 
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We can further rewrite that using the adjoint generator L* with respect to p: for any pair of functions 

f,9 

dxp{x)g{x)L* f(x) = / dxp(x)f(x)Lg(x) (35) 



Its physical interpretation is that it generates the time-reversed stationary process. It is important to 
realize though that this adjoint generator L* depends on the stationary distribution p, and is therefore 
most often not explicitly known in nonequilibrium systems. For equilibrium where p oc exp(—/3U),L = 
L*. 

We can verify that L - L* = 2u ■ V so that C = L* + u ■ V in (|3"4"j) : 

R QV (t, s) = P-^ f dx p(x) V(x) e^ L Q(x) - [5 j dx p(x) u(x) ■ VV(x) e^ L Q(x) (36) 
For jump processes, under Section I2TT1 

((L-L*)V)(x) = 2j2 J ^-[V(y)-V(x)] 

y ^ ' 

j{x,y) = W{x,y)p(x) -W(y,x)p(y) 

The equations (|34 p - (|36p contain the interpretation that the equilibrium form gets "restored" when 
describing the system in the Lagrangian frame moving with drift velocity u, as in [13]. Note that 
£ = L — La-, which subtracts the antisymmetric part La = (L — L*)/2 from the original generator 
L = Ls + La- What remains is the symmetric part C = L$, of course defining an evolution which is 
now detailed balance with respect to p. That aspect can also be realized path- wise: when $t(x) is the 
one-parameter group corresponding to the flow with velocity u(x), 

d t $ t (x) = u{<5> t (x)) 

then, yt = <&-t{xt) satisfies an equilibrium Langevin equation with potential — /3 _1 lnp but with time- 
dependent coefficients (in mobility). In other words, the passage to the Lagrangian frame of local 
velocity removes the non-conservative forcing, as explained in [13} I12j. Still, if we do not know p, the 
formulas (|34p ^ (|36|) contain unknown observables for statistical averaging. Moreover, thinking of spatial 
processes, the probability current has little relation with the real physical currents. For our formula 
(|15|) . one has an explicit expression in terms of known observables and p only enters the statistical 
averaging. 

Let us now see how the above expressions are mathematically related to our formula (|15p . For 
stationary nonequilibrium, taking p = p, it is immediate to rewrite (|15p as 



In fact, 



so that also 



R QV (t, s) = (3±{V(s)Q(t)) p - | ((L-L*)V(s) Q(t)) p (37) 



^- s (V(s)Q(t)) p = -±( V ( S )Q(t)) p 

= -((L*V)( S )Q(t)) p (38) 



as we have also seen in (f3T|) . or in (f34"P because C = (L + L*)/2. 
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Also for transient regimes we can rewrite the response formula (|15p as what one would get in 
equilibrium plus a correction term: 

R QV& s ) = 0^ s (V(s)Q(t))^ + 0^ s V(s)Q(t))^ (40) 

where now 

GpV = [—VL^fjL + L* (/^) - ^LF] 
Formula ([4U|) reduces to (f3"T|) for \x = p. 
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